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ABSTRACTf 

A' cost analysis was i^de oJlE cn-^line bibliograpl^ic 
'searching dtt four public libraries in th^' San F-cancisco" Bay Area ' ..^ 
'using the LocJc^^e^'IJIALOG system^ Th^ ^stu^y involved mpnitorincf the 
time that 35 inaiVia^2£l:& in the .libraries spent procesising "some 411 
search requests. The study ^identified a set of sev^ii, taE^ks that-ar4 
peirformed for each request and determiiied the aicerage^time^ anS cost 
for each of the tasks • The average total search cost was $*28em^ 
exclijrsive of telephone line charges. Th^s^ figure does include the 
a?tta base Connect Charges of $17 •29. The average time required to 
process a rieguest was .7.8 calendar days* A wide .variation ijx the. ccfst 
and time figure^s was found among the /four libraries and amoiig - 
individual searchers, (Author/JZ) ■ « . 



* Documents acquired by ERIC include many iiifofm^al unpublishe-d - * 
♦materials nol^available from other sources. ERIC makes every effort * 

* to obtain the best copy available*. Hevertlhelessr .items of marglng.1 ' ^ 

* xeprodiicibility are often encountered and this %ffects the quality 

* of the microfiche and hardcopy' reproductions* ERIC makes available 

* via the ^i^RlC Document* Reproduction Servicfe' (EDBSy\ 'EDRS is not : 

* responsib le or the quality of the \ original document . - ReproductlLons 

* supplied by EDRS are the best that can be ^ made from the original* . * 
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This pap6r reports a project, cornm I ssfoned by , Applied Cbmmim feat I on 
Resear<:h> Inc. as part of an on-gofng program studyinq potential user 
Interfaces for .orirUne search s^^rv(ce,s. " / 

This research ^r'ogra/ij Is funded by fhe^Of flee pf Science rnformatlorr 
Service, National Science Foundation, through grants to the Lockheed 
Missiles and Space Company (GM^2?99) and to Temple University (rN^l??.?!). 
Applied Communication Research, Inc^ serves aS' an evaluation subcontractor 
both project^.' / <' , ' 

Alice E. Ahlgr^n \s .program manager of the ACR evaluation of the 
Lockheed DIALIB- project. Colin K* Mick manages the ACR-Temple <iffort. , 

As"* noted In this rebort; the study was conducted during the first year 
.of a two-year project -A during the^ ''free service? portion of the study. 
As a result, the various\t{me festtmate$ have been affected b^ a number ^pf^ 
variables. The time estimates presentee! ^here may therefore be^^mlsjeadlnq 
for thq following reasons. \ 

1. The ^earchcrs were ^till In a learning mode '••^.the learning 

curvV for searchlngUshown by time per se^ffch) started at 31 / ' 
.minutes per search and flropped to about IB hi I nutes -at the eh d 
of the: free period (mean for the free periodMvas apprpx-tmately ?3 
minutes; . ^ . \_ * 

'7-.. Our data from the pay period (which began Ift June, 1975) : 
indicate that the searchers-are now becoming more sophisticated 
i and tend to devote more time to off-line search preparatlxjn 
and less tine to actual bn-1 tne' searching. . ^ 

, t ', , * ■ •# ■ 

" ACR, Lockheed and the partlcljf>atlng 1 libraries are no^i discussing the 
poss^h^^ty of replicating thl;^ study during the pay period. 



ABSTRACT 



r A cost'analysis of ^ill on-ll,ni5|blbllographlc sea/ch requests was 
conducted. The study Involved moijn tori rtg the time that 35 Individuals In 
four public libraries spent processing these requests. The study 
identified a set of seven tasks that are performed for each request and - 
detiermlneid the average time and cost for each of the tasks. The average 
total search cost was $28.41 exclusive of telephone line chargies. This 
figure Included the data base connect charges of $17.29* The average tlme^ 
to process a request was 7.8 calend* days. A wide variation In^the cosH^ 
and time figures was found among the four libraries and among Individual \ 
searchers. " t . ^ 



INTPOOUCTION - . . « 

On-line btbllographlcsearching Is be^comlng commonly u$ed as an aid to 
the reference librarian irtd resea.rcher.* Commercially aval 1 able systems, 
such as Locklieed's DIALOG and Sy&terri Development Corporation's ^P'^'^, 
provide access to a multitude of machine searchable data bases for this 
purpose. Many issues ' remain unresolved with respect to the genefral ^process 
of on-line searching. These Issues Include questions such as the 
effectiveness of on-line searching, methods for training searchers, and . 
optimal search strategies at the terminal. This paper examines the cost of 
on-line searching. On-line search cOsts Include t^e^charges that are 
Incurred for connection to a commercial search service, the cost of 
printing bibliographic citations, and the cost of the reference Hbrqrlans\ 

time. ' . . ■ ' \ r 

There are a number of refasons for studying the tost of on-line £. i 
searching'. In the first place, it seems apparent that on'-llne searchrng Is 
a cloSe substitute for some forms of non-computerlized bibliographic 
searching. If this Is the case, and'if the end product Is the same, then 
it is Important to know how the costs of th<f .alternatives compare. _ 
Secondly, costs are an Important top.1 to aid in resource allocation. The 
provision of any new service implies either additional funding or a 
"diversion of funds from one type of service to another. With cost data 
this type of decision can be aided considerably. Finally, costs can 
provide a basis for oiaklng pricing decisions. It seems quite likely that 
i/sers will have to pay for on-line bibll.ographi c seprch -services. The 
question Is, how much? While there are numerous ways I fr which prices can 
be set (I.e., loss leader, marginal cost, cost recovery), a knowledge of 
' costs can play an Important part in thfilr establishment. 

The cost data reported in this* paper were compiled as, part of an ' - 
ongoing prqject being conducted by the* Lockheed. Palo Alto Research v 
Laboratory under the sponsorship of the National Science Foundation s 
Office of Sclencte Information Service. As .part of the study, .Lockheed s 
on-line reference retrieval service (DIAUOG) Is b'elftg made avallab e^ . 
* through four public libraries In the San FTanclsco Bay Area. On-line \ 
search services were provided at no co?t -to patrons 'during the first year 
of the project (August, 197^ through H^yM975). The search- service Is ^ 
being provided at a reduced cost to patrMs during the second y<^ar of the 
proj.ect (June, 1975 through May, 1976). \ , 

The four llbrafles participating In the project are all members of the 
Cooperative Information Network (CIN) . » Bay: Area consortium of public, 
special, and academic libraries.. Clfl, in cooperation with Lockheed, 
selected- four public libraries In San.. Mateo and Santa Clara count te<s as 
sites for the placertent of compel ter terminals. The S I tes I npl uded the 
' Redwood City Public Library, the San Mateo County Library, the Santa Clara 
County LIbVary, and the San Jose Public Library. All Hbrarlesjin the .CIN 
networit were encouraged to participate in the experiment by ekher directly 
referring patrons or by' forwarding patron requests to one gf the above 
libraries. ; . ' ^ 



r- ^ Th6Jr\dI vf duals ivho per.fbrmcd the bnHIne searching and search* re la ted* 
- Interviewing had (with rare kkceptlons) no previous experience with 
on-Hne searching (l)/ A c6r4 of eight librarians (two from each library) 
r^ceJved(^e standard LockhetecJ Introductory course on DIALOG (2 4ays) and 
were allowed tlnfe to;.practfct searching. . -These librarians then provided 
/the search training to otheif staff members of their respective libraries. 



The experimental nature of this project differentiates It from ^the 
iiqrmal search situation. Purlng the first year of the project, each of the 
four participating 1 Ibr,arfes recel ve(t^th 16 Hours per month of free 
search time and 16 hours per month of , fr^i&MJemonstratlon time. Since the 
search time was fr^e, searchers were able to experiment with the system 
while conducting p^trort searches, - They were not under any pressure to keep 
the searches short ar)d efficient. On-line search times, and subsequently 
connect costs, repor^d In this paper may be somewhat higher than they 
might ha)/e been If th^s were not an experimental project In 
which f/ee search t\m was available tp, the libraries. 

PREVip^^ stuDl£S ' 



The development of adequate statistical (time, cost) monitoring 
mechanisms In on-line systems has been a slow'proces's. Monitoring programs 
took a large leap forward with the advent of commercial systems wh I c)i 
/equlre the preclsis re,cordIng of user-system Interactfon time" for accurate 
bi 1 1 Ing purposes. 



<? 



" ; Monitoring of the user-system Interaction can take many forms, th^^ 
simplest measurements deal with elapsed search tlme> time spent search l(ng 
particular data bases, and frequency of command uti I Iz^atlon* One of the 
earliest reports on' user, behavior ^ monitored by a retrieval system wafe 

, presented by Summit (I969) . Data reported Included elapsed search time) 
nu^er of Index terms usecj In a search, number of Boolean expressions^ us^cd 

*In a search, and numfser. of citations printed by the system. Subsequently, 
there have been a number of other analyses.. Of particular note Is a study 
by Benenfeld et al. tl97/f) whicft reported a comprehensIve;set of 
characteristics* of on-line searches. Among the vsrrlal^tesNcomputed were the 
time required to discuss the search with'^the.patron,*thtf search time at^the 
tjcrmlnal, the nuiriber of citations printed out, and the total u$er cost of 
the search. Benenfeld's experience Indicated user posts per search Im the 
range. of $28 to $56 depending on tfje, data cbase used. Lawrence, Well, and 
Graham (19 7'#) also gathered cost data on bibl logfraphlc searching and Elman. 
(1975) survfcyed, some of the previous studies and presented his own 
computations Indicating that an average on-line search cost, $47. Another 
aspect of on-line search^costlng that has retelved some attention In the 
literature. Is the cost of operating the tornputer equipment. L^ncastei: 
(1973) reviewed some of this lltfecature. It Is apparent thai thrs arta of 
cost analysis needs considerably more Investigation before; the Internal 
economies of on- 1 1 ne searching can be settled.* ^> 

CD It Is Only fair to note that one of the authors of this paper was .also 
^ one of the searchers being studied, an employee of San Mateo County 
Library^ We hope that no bias resulted. V * 



METHODOLOGY . 

The 'procedure for obtaining the data from which to cdmpute the cost/ of ^ 
pn-Mne bibliographic searching required the cooperation of all f ndivlyil^jals 
engaged \^ proces'sing the, on-line search req^uests. A^set of s^ven* t^$ks.^ 
was defined including reference Interview, orininatlng(>ibrary prepafsftron,^ 
OlAUWi library preparatloa, search, DI^LOGM tbrary follcw'-up, orlgMatIng 
I fbrary follow-up, and fol low-up wi th patron* A form was then developed to 
collect data describi,ng the amount of time spent on each task, the date on 
which the task was performed, aad»the individual who performed the task 
(Appendix A), This time sheet traveled with *the search request ^hrou^gh its 
^processing. As completed time sheets were received, they were riumbered and 
cdded fojr computier processing. In order to protect the anpnymit:y of the 
'library employees performing the varloxis tasks, employee names Were . 
replaced with code number^ for all computer tabulations. In the tables 
that r§fer to Individuals performing search taste', code number$ will be 
used. 'V ' ' , ' , 

* ' • . * 

Qosts were developed both, for* each searcj}_perfbrmed and for each task 
wl.thin-a search* Each task could be performed by a dl f ferent l.ndl vl dual . 
In ordet? to arrive at the direct labor cost for a search, .it was necessary 
tc/ multiply the pay rate fqj; eSch Individual Involved in the search by the ^ 
number of minutes, each spent.at a particular taskr ^ - ' 

In addition to the labor 'cost of a search, -two other costs must be 
considered. The fi rst Is 'the fee paid to t\?e c^merctal search servro 
thi^ cfa'se, Lockheed) to access the 1 r data base.]. This fee- is a funct>^n 
both of the length of r time one is connected/ to the system via tele|?hone 
line and of the particular data base (such /as ERIC^ HTJS, Psychol/ig'lcal 
Abstracts, etc.-) that is be>ng searched./ for e^mh-; request , mu]^iplie data 
bases' may be searched. In comput tag .the/ on-line <:ost f,or a sf^/ch, the. 
cost per hour of accessing each data ba^e was" multiplied by the connect 
tirae to, arrive at a totaT data base conriect cost* 

The second non-labor cost element is the, number of bibliographic ^ 
citations printed at the commercial vendor's computer center and sent by 
mall to the searcher^s location.. A charge is made for^these off-line 
prints and this adds to the total cos/t of the search^ , > 

■ . . I I •• ■. / ■■ ■• ^ ■ ♦ 

Several other factors could be Included In the cost of a search. -The 
major omissloa of this study was the co?t of telephone line charges. Since 
all the libraries were relatively clos// to Lockkheed^s computer center, 
they dialed di rectly to the center Without the use of an Intermediary 
service sufh as*TYMSHAPE. If an intermediary service had been necessary, 
these charges would have to be fncljlided in thp total search >tost« 

Other cost elements that were excluded from the study were terminal 
rental costs, physical space charges, and indirect cbsts of overhead, 
administration, supplies, etc. ' Basically, the cos| figures presented here 
sur.imart ze the dl rect cos<s of on-l |ne search I ng* 




The data for this study were collected during February, March^ and part 
of /^prll of ^^75^ Under the terrfis of the National. Science Foundation 
grant, DIALOG service was P'rovlded.frise tp the'publlc for the first year of 
th^ exp^lment^^and at a reduced rate for another year. The three month 
study pcM^d was^ one which occurris*d six monttis after the project had begun 
and during which the service was sti I T free to all users. ^ ^ 

It should be emphasized that the data comes from self- reports of the ^ 
library personnel. Such a method Is of course less accurate than an 
outside "measure, bijt was the only practical way to collect th'e amount and ^ 
variety of data n^ded. . 

' '{ " ' . . . , * 

At the end of the data coUectlpn period, hW usable time sifeets had 
been col lected f romr the' four DIALOG libraries (Table-l). 'Of these hW ^ ' • 
'33-6§ were from Redwood Glty Public. Library, 25.1^ from Santa Clara County" 
Library, 1T^% frojlti San Mateo County Library, and 18*7^ from San' Jose 
Publ Ic Library. Branch Hbraries and other CIN'' I Ibrarles took requests'* and 
relayed then) to tf^e 'DIALOd I Ibrarles; 16% of the requests during the 
reporting period showed some participation by these other libraries. 

THE. REQUEST PROCEDURE . 

. A general outline of the DIALOG request, procedure Is flowcharted In 
Figure 1. For the data collection, the process was dlvljded Into seven 
tasks which formed the basic reporting units on the time shee^ (Appendix 
A).. • . , • 

TJie tasks were deYlned by both where and at (^hat stage of Ithe search 



Ible typ^s of 
terminal (cal led 



process the acttvltytpok place. A maximum of two possl 
libraries participated In each search: a library with a 
DIALOG library) and a' coope rati ng library, a branch llby.ary, or other CIN 
member (called originating library). The tasks were farther divided 
according to whether the activity occurred before or af|ter the actual 
on-l I ne 'search. The DIALOG search Itself v/,as treated ais ai Separate task. 

The tasks wer*e defined as follows: • • ! 

<t . . • ■ ■ # ' 

REFERENCE INTERVIEW: , ttpie that .the user, spent^egotlatlng the » 

request by submtttlng and djs^iusslng ft wltK a library staff .member.. ) 

tfils could take place at efther a DIALOG library or an originating 
library. ' . . / 1 , ' ■ ■ ^ 



ORIGINATING LIBRARY PREPARATION: ' If the reference ikervlew was at 

9 cooperating library i the staff there might spend some tfme j-ecordtng, 

researching,; and transmitting the request. \ « 

DIALOG LIBRARY PREPARATION: time spent on the request\at the DIALOG 
library with no patron- present and before performing the on-IIno 
search.- Typical activities tnclMded recording the recklpt of ' 
the request, fllllrig out forms', and researching s'earchTterms. 

DIALOG CONNECT TIME or 0,NrLlNE SEARCH TIME: the actual DIALOG ' 
search. - - * . . , p 



. I)|,AL0G VfBRAPY FOULOW-UP: time spent after thp on**rif>c sc^arch,, v/Ith^ 
*no patron p resell t. Typically this would Include f 11 Hng oiit reporting 

forms, examining search results, and notifying the patron <>r ^ 

originating lltrary. 

ORIGIHATING LiekAflY follow-up : analagous^o OlALOR library foltow-eip, 
but at a cooperjating library. ^ t 



FOLLOW-UP WITH 



PATROM; at either type of library, the staff might • 
spend time Wltiv the patron explaining the results of the search. 

Thg only one of these activities that^^s essential was the actual 
dn-»llne search. Any combination of the ottiiSr a^ttlvltlfss might be 
performed, depending on the nature of the request ^hd on the library or 
libraries Involvec. The Individual libraries yarled ,]t;hls general formjn 
accordance with tf^elr own needs and policies. 



The Santa Claifa County Library Is a large systeh , with branches all over 
the cpunty and , a. research library In Cupertlnb where the terminal was 
located. Usfe"rs were free to submit requests /through branch libraries or at 
the Cupertino library. Over the course of tlils' study, virtually all 
requests or l^g^ina ted at Cupertl*no. The requestor, on entering the Cupertino 
library, ^as directed to a DIALOG-tralned staff member. If possible, wh.o 
performed the reference Interview. The librarian asked the patron. If 
^he/he. wished to be present during the searibh. In which cqse an appointment 
was arr3nge<l for some time Tn the future. - /Scheduled searches Were H ml ted 
to three or four per day, due to ""the deman(;is of other staff duties. If the 
user did not ask "to be present, the search was* performed at the searcher's 
convenience, often but not nedessarl ly by the same person who h&d| performed 
the jreference Interview, the user was caf led el ther when the oh-llne 
search was finished or when the off-line prints were received. Whenever 
possible a DIALOG staff member discussed the results with the patron. ~ - ^ 

. The Redvyood City Public Library consists of a main library and hfo 
smal 1 branches . ,Users wl tjp reference questions requl ring the facl l I ties of 
the main library were /sent there directly, .as were DIALOG requestors. When 
possible they were met by a DiALOG-tralned reference librarian, who 
performed both the Interview 'and search. The user was then called to come 
In to pick up the results an^f was met by a reference 1 lb r»r I an If possible. 
Occasionally, the results were mailed to the patron. ) 



/ 



' The San Josr^Publlc Library serves a metropol ftan area* The users with 
questions on DIALOG were referred to, the main library's scWnqe/buslness 
department whosli) per|onne^ Included two searchers • The,oth*f staff 
members In the depar^tment were also famMlar with DIALOG. The user filled 
out the request foirm, and might have, been briefly questioned by the staff. 
The primary searche^vdurlng the data col lection period was a student 
volunteer who came In^Rart-tlmc to perforin sear^ches. No particular effort 
was- made to have the patron talk with her, although she telephoned the c, 
requestor If she needed clarification of his/her request. The patron :' 
was notified, when the results were refidy, by the sea^rcher who explained 

^ the results, and the results were left In the science/business? department. 

/ to be picked up. A. note Was attached to the results encouraging the 
requestor to. talk with the se*6cher If s/he did not understand the 
citation or was Interested In Staining specif tc articles. 

t» The, San Mateo County Library alone among the t>IALOG libraries derived a 
substantial portion (about 60%) of Its requests from other libraries. Like 
the Santa Clara County L library, users were at I owed to place requests with 
the mhin ljbrary:Or with a branch or otheV CIN library; unlike Santa Qlara', 
marry, users opted for the . remote access. A I Ibrar Ian, although not 
necessarily one very familiar with DIALOG, generally performed a reference 
Interview for each request. Searches' received from bther 1 1 brarles or frortr 
walk**In business were placed with ojther pending searches ,^to be ' 
performed at the Ubrar tans ^ convenience. The* resuUS were often sent to a 
branch library, even whep' the request originated at the main library. 
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Table 1 • ., , 

Frequency Distribution of Requests by Dialog Library^ 



Library 


'Number of 
Rjsquests 


Percent Distribution 
of Requests , 


* 

Redwood City (RC) 


' 138 


■ — — k ^ r 

0 

- 33.6 


Redwood City. 

Henlo'Park ' v 


* '137 

1 ' ' 


• , 33.3' : , 
^ .0.2;. 


Santa Clara County (Sp) 


103 ' 


• ; 25.1 • 


Cupertino Research 
Center - • ., 






• 

23.1 / 


1 GiTroy ■ 
Othejss^ - 


i 




" 5 


1-2 . * \ 


Sah Mateo* County (5M) 


93 


22.6 = 


Central Library'. 


■ ^ 37 ■ 


9.0 




1 20 




Belmont ^ ' „ / 






1.5 


Foster City 




\, 3 


0.7 


Mi 11 brae r • 




. 2 • 


0.5 


Woodside 






0.2 ■ 


. Public Health, 
and Welfare 




20 


, - \ 4:9 ^ 


1 


Other 




1 4 . ■ 


l.p 




San Jose PLiblic Library (SJ) 




; 77 


18.7 /' 




Total.. 




411 


100.0 





^■ An independent library thaf sends its requests to the- indicated v 
Dialog library^ , ? \ - • 



f' fIGURE 1 . / 

FLOWCHART- OF DIALOG REQUEST PROCESS 



10 




STAFF. •■ . ■ , -^^ /;iv;././ .•. \ , .• 

' i>ne major decls Ion for a 1 Ibrafy tnstt tutlng thls-'klncf of service v|s 
that of how-to /staff the . se^C^^ The 1 1brarles consfdered ^twO inajor, 
ai:ternatJ,>^s. ,'. '* " '-V-^ * / ' '.^ - V * ■ . ^ '■• . 

/ 'First, they tioulrf designate 'orie i>r two pefop^ to do all thfe'^ searches.- . 
The advantage to .this would be that the searchers wbulff^quickly become ; 
highly ski lUd%VAlsOr the respohslbll I ty for D and DIALOG- re I a ted 

actlvltres' would 'be clearly, asslgnedw) However^ tt would mean that at times - , 
^he search st'aff wouVd not be avanabje tq users with qtuest^lo/is^or "J • 
problems , - .^ • . ■ * 

■■■ . ; J) ■ .: ■ . ^ .r 'V y ■ : , ■ ' ■ 

The alternative w^ps . to have a1 1 of the. reference personnel add DIALOG ' 
searcViIng to their usual .repertoire of Reference skills. This would : 
dfffuse^the searching, and therefore dif fuse both th«p experience ami thfe; • 
responslbJllty. However, jt\would Increase »the ayal l^blUty of tralne^^^^^^ \ 
personnel to users; so that "a request could be handled^ efficiently by : * 
virtuaHy. anyone at the reference desk. , ^ - 

Three the "! ibraries opjterf for thp second al tematfve^ At San. Jose-, • 
however; due to' special ciTcymst^nces (l) , most of ^e searching even t:u|ny|;|; . 
devolvW on 'one ^person. * ; ' . * - •■ 

' ' ai l of Redwood Ci%''^ participated' In DIAL06 performed, fat ^ 

one Vtme or arfother^ alTnost every .step of the'prpcedure,. Includtng the . 
on-! Ine -<scarGh. General ly, a librarian fbl lowed one request thi:pugh :, from, 
beginning to end. Santa .Clara County showed -roughly the same^attern^ ' 
,«rthough they did'have a few re^ue^ts that prlfftnated-::a 
llt^rtes" so that th6 people who deal t with the patron did not, per form" . 

' At San Mateo'. County Lvfbrary, Staff members from cbunty system , ' 

libraries frequently conducted some, of, the search taskl^ Of tH* twenty 

; peaple who were 1 ist'ed, on time Bheets.^vOhly f Ive performed isearfehes,. and , 
on iy four could be xhipi-acterized as regular searchers, ■^:y/, '{^ ' . '• - 

■ ■' ■ ■ : y. , ' - ■ : ^. ■:^ . 

^ Table 2' surrtnarUes the salaries of the 37 e'^PlpV*** 

.pyoc^sslng the on-line search requests. Participants* mean-salaries f or , ' , 
the job tttje ranged from a Ic** of $658^ f»er month for three Jib rary 
assistants to a high of 41 325. |6r a supervisory librarian {2}. For future 
reference, ^he table also shows the employee cbde numbers (^nstead of , > • 
employee names) for each job title within ea<"h 1 Ibrary.. r . 
- ,.■ " ■ -. ■• " ■• . ' : ' . " • .v " •■ ■ 

".■■'»■ ^ .• ■ --^ ■ - ' ■' ■ '■■ ' ■ ■ - t " . 

(l)Ncar-by San; Jose State University threatened to swamp San Jose Public. . 
; Library with requests, so an arrahgement was made whereby, a 1 Ibrary school 
' i'jstudent'" volunteer did a^ f^ (Sroportlph of the sefarchihgv <■ ' 

42)Employees ^f each of tbe d ties an4 coanttfcs In the study worked 4a - 
■ dlfferent^number of hours per week." Redwood CI ty employees worked SB hou-rs 
. per week whi te eraplbyees of Santa. Clara, San Mateo and San jo^e worked '♦Q; 
• hours. per week. When labor costs were computed this factor was considered^ 



' • : * Tabl e 2 ' 

• : ■ / : ■■ ■ ■ ' - . „ 

Salary .Schedul e for Library Employe'es 
. ' .InvoTved in DiaTog Process 





Library 


* ' • ■ . ^ ■■^». 
Job Title 


^Meah Montiity 
Salary ... 


" Employee Code Numbers 
in this Classificdtion 


Number of Employees 




Redwood 
city 


Librarian I 
Librarian II 
Librarian III- 


k' ■ 

fe; ,000.50 
1 ,083.00 
1,178.50 


24,^26, 27" . 

' ° 26 ' 
;■ \ 23 . 


. ,3 ■ 




Santa . 
'Cllara 


LibT.Assistv 1 ^ 
Librarian i 
Librarian fl 
Regional . 

Librarian I 
Supervising 

Librarian \ 

A- ■ 


' 764.00 
• m.50 . 
1,074.50 

l,12ff.50 

"1,306.00 V 


"35, 36, 37 s 
38 ,- 41, 4.3 

' ■42-'J'- " ■ ■ 

'■ ' . 44, . ■ 


• ■ . ■ -.1 ■ ■ ' . 

.■3 ■ ■■ 

> 


■ * 


Sarf 
Mateo 

* 

< ■ ■ . 


Libr. Assist. I 
^Libr:. Assist • U 
Librarian I 
Librarian I i - 
Librarian 1-IJ 
Supervising 
Librarian'' 


V 658.00 - 
801.00 
992.00 

1,112.5a 

1 ,232-.00 ^ 
.1,325.00 


2. 9, n - 

13 

1,10,1'2,HJ6J7„18 
6;-7/-8 

15 ': . ■ " ' 

- r ♦ - ' - 
■J 


■ ' : 7 - 

3 




San ; 
Jose 


Librarian, i*' 
.Librarian j J 


-955.00. 
1 ,052,. 50 


•^0*,^51,.53,^, 
"52 54, 5^ 


- '4 ' , • "■ 



id yolunteerj salary ealcuU^d at LibraHan I I'eveJ for purpose of study; > 
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In Table 3^data are presfented tinrthe frequency with wjilch various 
employees perfornTerf each of the seven tasks connected with a search* For 
the'entiVe e><pejlmcnt, 1595 taisks were performed for the k]X search .requests 
averaging abclut 3.6 tasks per. search. 429 searches we r«f pejformed for the ' 
•411 requests I n'd I jjjUng t^ vary few dupUcate searches wfere made for each 
requesu EmployeWpp at Santa TJara^ C^^ the greatest number 

of tasks while empiloyee^^ at Redwood cfty ranked second. Together these' 
two .ert<>1pyees accounted for 20% of alt ta^^^ , ' 

DATA BAS£S . , v 

Onfe possible source of, .variation among the libraries was the choice of 
data bases used for the Search. Since the different bases cover different 
f»ubjects, variations jn base use «;ould Indicate that the ll^brarl.es receive- 
different types of requests, arid/dr. that .the librarians/ search habrts 
differ. Also, since the bases* hourly rates^^vary, differentiated -use could 
affect the cost of searchfng "(See Table 4). . \ ^ ' 



r The most commonly used "bases, (1) , for all the Hb rarjes taken ^together , 
were OTIS (accounting for \7.Bk% of the bases used), Psychological 
Abstracts (16.^7%) . and ERIC (13*35%) (Table 5)* NTl'S T$,a highly varied , 
base that covers a wide range of topics, and the documents abstracted were 
r^<lily avail able to the project participants through purchase from MTIS^or 
on loarf from the Gal I forrila State library. Pyschologlca) Abstracts (PA) 
and KRIC cover psychology and education j respectively; . All three' <)f these 
could be expected to be of use- to many public library patrons. The. next 
most used bases were Social .Science Citations Index (9.51%) > COMPENDEX * 
(COMPuterlzed ENglneerlng InDEX; 9.59%) , and ChemlcaV Abstracts Condensates 
(8^23%)»/the first ties In well with the first three basesj the latter two 
are equivalent to weU-lyioWB^h^r^^^ services. The least used bases were 
al l Pretilcasts bases. Including PATS Source, (. 11%) , PATS Claims (.21%) , .and 
PATS Chemical and Electronic Market 'Abstracts Weekly (.85%). Al l are 
speclalrpurpose bases. . ' . / 

.>■.■■■-■■■ V* ^- . ■ * ■ ^ . - 

V Considering the* 1 Ibrarles Individually, their data base usage did * 
^differ from the gVoup percentages, but^not markedly. For. example, the; 
group proportion for NTlS Is I7is8^%; Redwood City's figure was 19% as were 
Santa Clara^s and Sarf Mateo's; While San Joise's was 13%* Psychological 
•Abstracts* group percentage was 16*57%; the Individual proportions were 
22% and 13%. * 



(l)More' than one base miay be used ort a search ;^ thiijse ate the prjoport lt)hs of 
bases use^l,, not of se^|]^hes performed. 



° ; • Table 4 
Data Base Connect Charges Per Hour 



15' 



i Data base name ' 


- Charge per connect hour 


Charge per off-1in6 print* 


ERIC- . , . 


... .- - .^ - 

, ■ : •. $.. 25. .U;;. 


$ O.fO ' 


CHEM ABSTRACTS • 


45 


0.10 


, EXCEPT. CHILD ABS 


25' . ■■ 


OAO- 

•> . , 


NTIS • ' ' 


.35 


^ 0.10 * 


SSCI . 


70 • 


r - 0.10 _ 


COMPENDEX ■ 


65 <fi 


. 0.10 


AIM-ARM ' - 


; 25' , ■■■■ 


O.IO ' 


MAI /«»ATM . ' 

NAL/LAIN V ^ - 
PSYCH ABSTRACTS _ ' 




■ O'lP 


■ ' - 50 . % 


0.10 ; • 


INSPEC-PHYSICS • ; 


. 45 ; • • 


r.io 


INSPEC^ELECT.' EN • ' r ' 




' ' 0.10 r 


INSPE'C-tOMPUTERS . - iv 


■1 45 ' 


' ' * - . 0,10 V 


.'■ABI/INFORM ' . ^ 


65 


O.IO- , • 


PATS CMA/EMA 




\ 0.20 


?ATS C/EMA WEEKLY 




0.20 


PATS F and S." 


. . 90 .. : 


0.20 


PATS Source 


■.■ '\ - 90 , ■ 


0.20^ 


•IFI/Ciaims ^ ' 


•, ■ ■ ° '•■ '.,$^150 ; ^ .. 


$ 0,10 • » 



ERIC 



A-' 



these were the basp^'^^ available durlngtfie data "col lection period. 
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Tables. 
Dati Base Usage by Library 



Data Base Name 



Number of Data Base -Uses by Library 



RecWood' 
City 



Sarita 
CI ara 



; San 
Mateo 



San 
Jose 



Total 
Uses 



Percent 
Distribiiticin 
of Usej? 




ERIC 

CHEM. ABSTRACTS 
EXCEPT. CH I LD,AB§. 
NTIS 
SSCI 

COMPENDEX 
AIM-ARM 
CAIN \ 
PSYCH. ABSTRACTS 
INSPEC-PHYSICS 
iNSPEC-ELEdT.ENG 
-INSPEC-COHPUTERS 
AB I -INFORM ' f \ 
PATS CHEM ELECT 
^ATS CH EM-EL WEEK 
PATS F-and S 
PATS^ SOURCE . ■ ■ 
CLAIMS/PAT PRETS 



44* 
29 
2 

61 \ 
32 
24 
1 

14 
56 
12 

4 

2 

20 
7 

10 

. 1 
1 



3a 

15 

3" 
45 
27 ^ 
27 

"1 

5i 
.33 

7 
12 

4 
11 
10 

3 



18 

21 
5 

35 
5 
5, 
3 

12 
.40 
4 
. 2 

• 3 

. 11 



.25 
12" 

; 6 
26 

.. -25 
•-25 

. '5 
9 

26 

. 2 

2d 

6 
5 

10 
f 



• 1125 
77 
• 16 
167 

89 

589 
. 10 
40 
155 
25 
20 
9 

62 
■ 23 
8 

^ 20 
1 
2 



■535" 



TOTAL . 



320, 



243 



180 



193 



Present 
Distribution 



34.19 



25.96 



19.23 



• 20.62 



100.00 



--Although on the library level no significant differences appea/. wfijen 
broken down further to show the fudtvldual searches , dl fferences oecome 
apparent (Tables 6 and 71. The most skewed figures are for searcher 3.^ who 
IS a special j Ibrgrlan and whose search pattern reflects the spectalfi^d v 
interests of Her cHifents, The pther searchers, howevcrV have no such e^lsy 
explanation for their preferences. Looking at the ipqst frequently ifseH 
baie, ;4T|S, the. frequency of use varies fron\ ^.k% to 23.8* (Table 7). Even 
excluding searcher 3, Psychological Abstracts varies from a low of !i*9% al.K 
the way jjp to a high 6r 30;8%. % . . . T . 

We can only guess at reasons for this variation. ' 1 1 may^be that some 
searchers have certain sMbject expertise, and that the searches within a 
library are parcelled out accordingly • However, none of the libraries 
reported any such pattern to their searching. , 1 1^ Is more likely that users 
fall Into habits of searching and .tend to use bases with whl^h they are 
familiar. The jvost frequent searchers (23 and 50) show -more of a 
scattering ampng'the base*, sbjt may be that their added expnrl4nce ha$ 
encouraged them to' brarjch out more, whl le. other searchers stick wl thij*safc** 
bases. AUo, doing more searches wl 1 1 no doubt brlfig the searcher a 
greater vai'l^ty of topics, and require a gr^eater variety of bases. .These* 
are just .conjectures i as the figures are not conclusive. If the searchers.: 
were either very conservative 'in thel r use of ••new»* baises or were strljctly 
segregated by subject, they wou1.d center their searches on a handful of > 
bases. However, almost all pf them used each of^ the more popular base^ at 
least once. ' 4 ' ■ ' ■ ^ . . ' . V 

■ V- ■ ■■ ' ' ■ „ r .. ^ ' . ■■ v^" ■ '■ '\ 

Table 8 breaks-down the ^average time ^pent on each dfiita base by the 
most active searchers* Again, the resuftfe shoi^ very 11 ttle unlfor^I ty 
amoncy the :searchers. No one-^base tends to 'be a tltne-consumlng base. The 
searchers varied widely In the average time that they- spent on a single 
base. There seems to >e some Intra-llbrary similarity, but It Is very - 
sl lgh't; the San Mateo County Library sesrrchers :a1 Khad fal rly low. averages, 
the Redwood City searchers a little' higher^ thf San Jose people about the 
same as Redwood City ^r perhaps a little higher, and Santa Clara County- 
hlghest^of all . * These figures are not directly c^^^^ the^mean 
on-line time per search si nee any number of bases can h€ used on a single 
search. However, they are somethTpg to keep In mind for the discussion of 
\tlnie per task 'that follows. If a search^used the same number of bases," 
.and >the average time per base differed among the libraries, gthe evera^e 
on-^l I ne tlme^ per search should vary accordingly # o 

,OFF-LltiE PRINTS 

■ \ * ■ ■ '. \ ■ ■ - ' '.' 

• The humber'of off-line pr'tnts requested was-^a major variable Vh the 
cost of- the search, , San Mat<o County tried not to print, more than flfty^ . 
citations per search/ but that was not a Hard and fast rule. There were' 
two reasor|s for this guideline. First, the number of prints available 
under the :teCms of the grant was limited (although no library overran this 
Ilwlt during, the first year^f the study), .Second, If the patron received 
too many prints with t6o much Irrelevant Information, the precision and 
the^'efore t^he quality of the search was lessened. 



■ sz 
I— cn 

- Mr ' 

Id 
o 



ERIC 




Total 
Uses 
by • 
Searcher 


in CO 


a 

<NJ CVI O CM 
to to r*^ 


« 

to CO o 
00 fN, 00^ 


■ ^ < 'i. 

o o rv- 

^ O CO 


^- 
«^ 


CO 
0\ 


• 

o 
c 

« <y 

a* 

m 

0) 

' (A 

(/) 
' Id 

03 
03 

1^ 

O 
1 

1 

- * 

a 

1: 


u 
o 


e 

/ 


r** CO 00 CO 


Cl o> 


CM iO r-" ' 


' CM 


lO 
CO 


CO 2 
< 




■. • ' . * 
r-^ t— r-^, 

■ ■</■ 


CM CM 

■ . • ■ 






^ CO 
CM 






, 0> CM ^ ' 


CO I—* r*> * 






CM 
iO 


INSPEC- 


■a 

f 

^ CM 
' t * 


CO 1 CO r-» 


' CO CM CM 




ii • 
< 

• 


LO 

CM 


-a: 

Ou 


n\ /vS 

rr , ^ y 

0 , * Iff 


/ . 


ST *?r 


0> CM ^ 


CM 


'in 
I— 


o 

> • • 




io CM <;^ ' 


. CO CM . 


CO <h CM 

\ 


ID 


CO ' 
CO 


LU 




rvl a-A* 

PSr . 




CSS Csl CM • 




cp 


CO 


Am \ 


■ CO 'Jt* ' 




ir\ /N.I toi^ 

vL> VVI 


cO 






1^^- -^^^ 


VLJ 

CO 1— 


«-4^ 

1— r-^ CM 


r~" p** ^ 




VI J 


2* • 

S to 
CO 
p< 

f > 


VJLi' V'/ "SI 


fvi lo ■ 

SmI ^^Xi/ 




CO CO r-* 






'ERIC 


rrt ^ir» 

V'^ 


cr\ r\i 

UPl i'^ Ul 




rv^ /Vi " 




U/ 

CSI 


Employee 
Code 
Number 


.\' J U/ Wm/ 


I. 

nrt cr4« LO tn 

CM CM CM 


CO CO CO 


vin in to 


tn 
o 

5 


Total 


Library 


fd rd O 

.-3^0 


Redwood 
City 


Santa 
Clara 
County 


<u ' 
c; i/i 
<d o . 
V5 rD 



OJ 

XX 



OJ « 

JC 

u 
s. 

OJ 



OJ 
t/J 

CO 

4-> 
O 

<D 

OJ 

o- 

-M 
S. 
O 
CX 

£' 

a. 



ERIC 



Percent of 
Total-. 

Uses, all 
Search 


■ /■ ■ ' 

csi tn ib"o 
)••*•• 
00 tn '<n Lo 

i * 


f ' ' 
■* ■ ' 

00 ^ to in 
ff • • * 

lo to r** ^ 


OJ q(i u> 
* / • ■ • 

OIV 00 


r> jSJ o 
o/oo to 

v ■ 


• 




o 

• 

o 


Total . 
Number 


Ui 

H- 0} 
O l/t 


rco ID 00 «;^ 
• 


W OJ o cvi 
in m r** , 


lb CO CD. 

r>» COy^ 


'/i - . 

/■.... 

o o r% 
o CO <h 

r— r 




CO 






Other 


3.3 
17.6 


lO 00 ^ r- 
i • ^ • 
^ to r-f t> 


Lo in CO 
* *. ' * 
o in r— 


o h> 
• • 

CVJ UD CO 
r-^ CVI 




to 

CO 


CVI 


Percent of. Searches Conducted by Searcher, 
• • / by Data Base - 


PATS 
C/EMA. 




i ^ 

cn "ct 
i# • * • 
OJ r- r- OJ . 


00 o 

. • • • 

OJ OJ to 


O Sf 
• • 


COs 


00 
OJ 

V; 


tn 

CVJ 


1—1 

CO 

• < 


co/o 00 

• • • 

CO OJ OJ 


CK 00 CTk 
> * » 

in CO OJ 


in 00 

. ... 

00 r— 00 




to 


CVI 

to 


to 


INSPEC- 


V 

O 00 
• • 

OJ ^ 

0 


00 CO cj* 

tn •^jt CVJ 


in f**^ in 
• . « 

CO OJ OJ 


* CD, 00 
r- 00 


OJ 


in 

OJ 


• 

OJ . 


a. 


. o 00 in 00 

■ ■ • • • 
O 00 r- 

in f— OJ CM 


CO oo o cn 
• • ^ . 

o a 


■ CO in CD 
- ■ • . • 
vo o in 

r- CVJ 


\mj 

. / $ • •' • 

cn to 00 


• 


in 


in 
to. 


CAIN 


o av in 
• • « 

OJ OJ 00 


o> .00 r*> 
• • > 
CO CO in, 

" s 


. ' ^ir^' in 


/-^ rfV% rfV% 
• V-J vv 

00 CO 


14.6 


do 

00 


.- 


t— 1 

UJ 


UD \o tn 
, h>oco 

• OJ 




* in 00 00 
. . • 

O iO 00 


/~S >w 

. • • 

ori to •sf 


• 

1 OJ 


»• 

CO 


00 


SSCl 


10.0 
2.0' 

- 2.1 


LXI 

• , ii • 

CT> CO HSr r— ^ 

, f^r* r— 


r*" n*» 

. » 

in CO in 


t*ifc^ LO 

\mmJ 

, to to 00 


00 




• 


NTIS 


00 <jD in 00 
• • • * * 

CO 00 r- 
OJ 1— OJ OJ 


f»i«Le irv ■ 
r*s 1^ \^ 

• • m m 

.a» u> cT^ 

OJ t:-. r— 


Cf^ hw 

- 

» • * 

lO (*> lf> 


n.o 

23.3 
6.4 


14.6- 


in 
to 


17.7 


CHEM. , 
ABS. 


00 to tn 

• «... * 

f— ? 00 00 


VO CO U 

uJ CO d 


> CO 
.' . 

) CO 
CVJ 


2.3 ' 
4.1 
12.5 


O O r- 

■ * « " ■ 
CO O CVJ 


22.0 




00 
00 


" ERIC 


K VD ^ 

• • • 

in o <i5 

r- CVJ 


12.5 
25.0 

1 TO O 


> CO 


00 00 00 
" V « * 
0% 00 00 
r- OJ 


o CO 
. * . 

CO to 
r— OJ 


• 

CVJ 


in 

CVJ 

> 


00 
r— * 


. Employee 
Code 
Number 


00 in 00 o 


• ■ 1 

CO ^ m 

CVI OJ cSj OJ 

•. ,1 • 


in UD 

00 CO CO 

\ ■ 


O CVJ CO 

tn in tn 
#• 


Ail others • 


' - Total 


Percent of 
Total 1 


Library 


San 
■Mateo 
County^ 


Redwood 
Citv 




>* 

nJ rtJ ««-> 
4-> C 

C =5 
fdr*-< O 


C t/)' 

mo 



19 



OJ*- 
o , 

OJ. 

it:- 

C 

c 
o 

5- 

B 

-o 

. in 

• 3 

£ 
o 



-P 
JZ 

t7^ 



in 



C/) 
C7» 











<u 












o 






u 






rd 






(U 




0 


• (/> 






>>' 






JQ 








<^ 




OJ 


to 






OJ 










h- 








c 




+J 


•p- 








rd 








c: 


c 




c 












- OJ 






(A 






rd 






CO 






rd 












rd 

































Id 


to 


u 


(U 


rd 






<u Id 




CLX) 


C3 




<d 




(U 


E Id 




•r- 


<7 





(U 

to 

rd 
CO 

rd 
+J 
rd 
O 

o 



' E 
•r- 
h- 

O 
(U 

c 

• c 
o 

c 

rd 
(U 



I 

O 

UJ 



UJ 



CO 



UJ (/> 

rn CO 



0) 

2>) (U (U 
O X> JQ 
f— O E 
CLO 3 

E z: 

LU 



rd 



O CNJ AO U> 

m o CO 

• t • • 

CO tn ^ 



CO CO 



01 " 00 

• - • 

r- Csl 



O CVJ 

Kt a* CO 
• • • 

00 O Ki- 



CO 
KO 
m 

in 



r— LO 



O 



CM ^ LO 



I— CO a» 

• f • 

0> CVJ ^ 



H-4 




00. 






o 




• • 




CO 


^ CVJ 


CVJ 



00 r*s. 00 
co r^ o 



00 
00 



00 iO CO u> 



I — KD 



00 CVJ 



io CO 
cr> CVJ in 
* « • 

«^ VD 



00 in 00 O 



o 

OJ 
rd rd 

00 s: 



oo> o r>. 
CVJ CM m cvi 
• ♦ • f 
e> o rN CO 



CO O'O o 

t— cvi o o 

CO O 00 

. ■ ^ 



CO «X5 
r— in 

CVJ r— to 



CVJ 
CVI 



oo 

o-o 

• • • 

in 

•r- CVJ , 



to CVJ r^, 00 

0 m m m 



li? OJ Ps^ 
<0 (Ti C\l 



in ^ 00 

00 CO CO.O 



CO o o 
^ CVJ in o 
• . « « • 

CO >^ U> 00 



e> f— in 
u> 00 CM 
• t • • 

io 00 p 



CM OTk O Cb 

r>. Oiin 
« # • • 

lO iO iO lO 



in io CO o 

OO ^O CO o 

♦ * ♦ • . • 



CO in io 

CM CM CM»CM 



a 
o 



in OMO 

m,o CM' 

■ ■ •'■ ■ • • . 

CMAOr^ 



o CO 
a> CO 

«^ CD r— 



CO 
r>. 
• • • 

,0 «5f in 



SS CO 
CO ^ 

iO iO CM 



O 00.00 

. cn .0 CM 
CO in 

i—w Csl 



CO 

CO <o 

CM 



^ O CO 

• • «' • 
r— cn 



r— 00 «^ 
XO CM 
' '« • • 

o o 



■ • * 
CM 00 CM 



CO ^ CM 
r— CM rs 

^ in 



CM CM r-v 

intCT* CO 

: • * • • 
0> I— r~ 
r— CM 



in io 

CO CO CO 



Id fd 

4-> $- 

c Id 
rd f-* 

00 o 



CO O CO 
^ Ln 

CM 



CM 
» • 

CO 



in 

CM 



CD 



m 
o. 



in r— . 
GO CM 



0 «15 ^V. 
^ r-* iO 

^ cn cn 



cn *i5 
^ 00 r- 
» •. • 

^ ^ o 



o 

«^ r— 
• ■ • • 

'r>. KD Kt' 



CO in o 

CO O 00 
• • • 



00 U3 in 
00 
♦ ♦ 
o\in CM 



CO cri CO 
CM o cn 

0> r— CO 
r— CO 



O C<l CO 

in in in 



c 
cd 
to 



0) 
10 

o 



•1 



Id 

Q 



ERIC 



x: 
o 

</) 
c 

•r- 

o 



O 



Is-':? 



C 

cr 



c 
•H o 

CO 

rd 

CO 



OJ 
Q 

to 



o 



1. 

OJ OJ 

in 



o s- 

o >^ <u 

'tS' 



So 



o 
to 



CO 



OJ ^ 

x: to 
o 

OJ 

CO 

tn 

CO 



CM 



CNJ 



4^ 



o 

Id <1- 

(U CNJ 



o 

OJ 

s: c 

C Q 

fd u 
to 



CO 
CM 



o 

z: 



CO 



u 

Mr 
a to 

rd 



CO 



•d 
> 
u 

(D 
4?* 
G 



r>. o <x> CO csj r^i-^ co 



CO 
CM 



CM 



CM 



Or- 



O CM CM 
CM CM r— 



CO UD<O OJIr— 



in r- «5t 'cm CO ' r-^ r- 
O CM 



CO 



O 

in 



cm m co^ » r*- 



CO 



CO I — O CM'^ CO CM ^ 
m f— r— r-^ 



r— VO 



in CO o CM 



lO^ro tn CM in tn ^r- 



^ininiOr- CM CM 



in r— CO o in cm cm i 

^ CO 1— f— 
CM 



^N- CO o lo CM 

tN* 1— r- 



ch tni^ in 



r— tn Cyi CO 
O I— 



ct> in CO 



> 

? ch OI fld 

O r— CO tn R Ch r— r-i— •<i 

I I r I \ I i * » 

i— o o o\o o o o o 

CM ^ lO\00 O OJ <f U5 



o 

CM 



CM 

CO 



in 



o 
cx? 



o 
tn 



CO 

to 



to 
o 

Cvl 



o 



in 
tn 



tn 



CM 
CO 
CO 



00 

o 



to 
ov 



CO 
CM 



tn 

C7> 



id 

,2 



CO 
CO 



CO 
«> 

CM. 
CO 



CO 
CM 
• 

CM 



CO 
-• 

OJ 



CM 
CM 



^cn 

CO 

o 



as 
to 



00 
CO 

.CO 



CO 
00 

CM 
OJ 



to 

CO 
CO 



o 
c^ 



o 



CO 



CO 



c o 

s: o 



C J- 
CU UJ 



It 

CM 



tn 



tn 



o 
o 

to 

OJ 



CM 



to 

« 

CO 



CO 



to 

o 

PJ 



CM 

- • 

cn 



CO 

to 



CM 



CO 

CO 



to 
tn 
# 

00 



CO 



CO 



o 

CM 



CU c: 

c o 
#d 

CU H- 

s: o 



, iA 
I CU 

O U 

^ c 

(A Ul 

C O 
•r- 5- 
U CU 
CU Nl 




' Whatever Its effect on the quality pf the search, San Matpo's practice 
of limited off-line p.rlnt? had a marked effect on searches *complteted at that 
library. San Mateo C6unty printed an average of 29 citations per search 
off-line., where&s San Jose printed 66, Santa Clara Cognty 71, and Redwood 
.Clty75. . „■ ... ° , " • • . ■ . - ' ■ • ' ■ 

. / * ■ , , m . ■ ^ ■ " ■■ ■ 

Table" 9 breaks down Into Intfervals the nurrjber of cff;atfons printed out 
off-'llne per data base (more than One base coy Id be used on each sear^) by 
searcher and lndlcdtf?s the mean nurribei* of prints per base bcftH for the , - 
searchc? for whfch prints were made (the ^non-zero entries) , and for al 1 . 
searches, Including those for which no prints were made. The figures 
differ strikingly, 

Th^ Intervals show an expected deci^ease In the number of occurrenires^^^ 
moving from Smaller numbers of printouts to larger^, tlo off-lJne j^rfnts we/e 
* requ(i?sted fi^om mor^than half of the data bases; this C0iild1>i5 because the 
search results were jiot satisfactory-^ or becaus^^be^^^^r^^ ^ 
were printed on-l Ine, Mt) searcher made^^r^acttc^ of printing monumental 
bibliographies. The mean j^ljieWre ro6r<H4nformatlve, showing, some fairly 
significant dlffer^mceir afSbng searcherSf 



r-^The meart numbei: of off-line prints for all cas^s (Including those 
searches for which no prints were made) was 1^ •26 for S^n Mateo Cognty*s 
searchers taken al 1 together, ranging Individually from 10,73 to 19. OA 
(Table s). Redwood CI ty^s dveral I average was 32 •98| Its librarians rgn 
from 16. g'* to 39.38» V Santa Clara^s overall figure was 29.^0, the 
Indlvlduail f Igures f rom^ 21 .81 to ^i6.39» San Josefs llbrary-wlde mean was ^ 
23.92, Us Individual low 18.31 and Its high 32.37. \ - ' 

^ General ly> It can be said that searchers varlc^i widely when dccjdlng / 
how m^ny^ citations were necessary and/or acceptable to the user. The / 
Intra-llbrary slml larl tIjBS are marked only for San M^iteo County. Otnefwlse 
It was the Individual dnd not the library who was the determining' factor In 
the number of prInt-outs. / ^ 

TIME PEB TASK . ; * 



Another major sdurce of difference was the sftaff time devoted to each, 
task. From the descriptions of the various libraries ^request procedures. 
It Is evident that 'some^ placed more emphasls^oh certain tasks than did 
Others. Tables 10 and 11 quantify this difference In two' ways. Table 10 
.Is the mean time per task,' by 1 Ibrary , for all non-zero entries only; I.e. 
oince It Is dfeclded that a task Is to be performed, that. Is the average tt me- 
for tbat task. Table 11 averages Into Table lO^s figures the entries with 
values of zero, 1;e. those searches for which that' task was not performed. 
In many cases .zero entries are;a significant proportion of the 
observations.^ • \ , * V - 



. : Table 10 ' . 

Mean Tinfe Per Task By Library, 1. 
(in minutes) j 
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. Table n 



.Mearfc Time Per T^skjiy Library, All Entries^ 
\ (in mTnut-es) 
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* / " Ta^le 1^ shows differences arrK)ng lib rj^rles, but none vary m^^ ^ 
> group n^itti.- Th^^ search t1in^» ^hlch varies from *a low . 

Qf 1^1.09 ml hutes for San MatM tounty; ttf a hlgh^ of 30#\2 minutes for iS^nta « ^ 
.^^^.^..-^ara Countyt with an overall mean of 22.72 minutes.; (ftore abodt thls/^ 

* lateirp However t Table 11^ brtng^^^^^^^ o 
reference Interviews were ^^^^^ for al I libraries ;e}(cept Santa 
Gl a far County, where the average w#s-tr^^^^ observation^' jn 
the Wo tables e)<plaln<^the'rf^^ 

; were accon^an led by a IrciTiefeftfce li^ ^ • \, 

• percentagt^^as. Sap Jose '^t^Jilp^ Slrt^ • '" ^ 
a[5 measured In Table H vaiW^r froni # lo^^ City) to . 
a htgh of Jft^56 mlliutes XSan 5^t*o CduritVir OnJy^J«fi?r;Qf Ret^^ City's ? 

* t requestis had the DIALOG ybfar^ follow-up pefforiwdr whf ie 89?[ of San Hateo 
" ::-Coun.tyU did, \ •,:v.;:;:a.,';.. ,-. " 

/ w V > The concVus|on';theii^^ In tln^^per 

task was whether or not tbe^ t^isK^^w^^ d[ecli^pn was; made. 

1. Jto pep^rrr^ the ta^k» the tinie requlri^dli^ 

iearch tlnie was the' one Important ext^ttt)^^^ This Ume Is especially 5: 
Imp^rtarrt since it determliied mfit only salary ^Kpendlt^^ ^is dld [ 

' other t^sks> but also the chai^ for cdW^ as wlj J| t*2 seen^^^^ 

was a signtftcant, part of jthe overal l cost. .^^^^^^^ ; 11 v 

In order "to statlstlc^My <iBtermliie if thare^A^ cHfferences 1$ t^^ , 
times taken to perform eatdh of the' seyeh taski acro$$ the four Tibrarlesi a 
set of Ahal^yses of VartaricesMf/as^ t^^^ are reported ^ ^ 

in Tab^le The tabl*" shows that th6 revere si ' ■-. ^ . 

/ the ttmes taken to perform the refiference I ntervtewi search ^ arid DIALOtS ^ / 
library fbl low-up^ 0^^-^ ' ^ 

* WhUe the Analysis of Variance ^^^^r^^^^ In group 

me^nst by Ttself It did not Indtcate/whlcft o 

was s tgnt f leant ly different from any other. To determine thl^^ systematic 
comparisons- of all possible combinations of task tltne mean values^ were 
: pcrforf^iftd and the Results evaluated us I,ng^Scheffe*s test (1) * Table 12 jihows 
: that for the Reference interview there was a*^ significant : difference between - 
^ Sarita ClaraU (SC) time and the times of Redwood Ci ty {RC)^!^ San Mateo (SM) / 
' *artd San Jose ^SJ) ^ but that there was no difference between the latter three ' 
i means. ^Similarly for search timet Redwood Cf^y and San Hati^were 

significantly different frbm Santa Clara and San Jose ^ V 

. • PATRON *S PRESENCE v . ^ 

J ^(me decision thatt the part^ 

the requestor should bi^ .present during the search* On the one hand, ^he 
requestor was (^f ten much more familiar with the subject than the librarian 
■^^^ was *^and could^l^^ both an Instant evaluation of how we f I the search was 
^ r goifHj and perhaps suggest alternraj^t ye search strategies The process of 
# the search might alsjo jielp^^raw oU^^^^^^ patron » and help * 

• him/her understand what" the l^l^^ to know. ^ - 



-a? 



(l)See (Kirk, 1968) for d-dtscusslon pf this prlocedufe* The test \.was 
conducted at the 0.05 level of si gnl f I cahce. 



. Table 12 V 7 
• V Analysis of Variance for Task Times 



Variable Nani^ 


Source: , Of 
Variance y 


Degrees 

of 
Freedom 


Mean 
Squares 


F 

Ratio 


Probability; 


Scheffe's Test 


..Reference Interview 
•Tlitie .. > . , 


0'etwVen Groups 
Within Groups 

.'t r \ ', — . — ■ ■• ^^, , ■ 




26.46 . 






(SC) i- 


Onginating Library 
: .Preparation. Time , 


Between firoups 
..Mi thin Groups 


45 


• -1 84*00 
^897.27 




QfSO 




Dl^Jqg Library ; 
Prepa^atijbn Time- 


. • ) • ■< 
Between -Groups 
.Within.JSrpups 


3 

219 ' 


85.45 
. 7a»84 - 


1 .16 


00*7 

•327^ 




'Total Search Time . 
at Terminal . • 


Between (Sroups 
Within 'Sroufps 




5528.85 
258..71 % 


21.37 


.000 V 


(RCSM^VS - 
(Sd,SJ^ 


Dialog Library 
FplToW-Up Time; .' 


Between Groups , 
. Within Groups-. 


304, A 


830.86 : 


19,iB0 

* \ - * 


' .000' 


(RC.$J:) vs 
(SC) vs (SM) 


Ofitii nat isg'^ L ibrary • 
. FoT4ow-Up Time- 


Betw^ein Sroups - 
^ Withih JScQUpk 




in:&5 ■ 

" 83.20 


;. 1 .356 


••J .272 

- ■ ■ \ %■ . 




Follovz-tip X,ime ' \ 
With Patron . v " 


^Between Groups/ 
•' Wi.thin Groups 


y .-- : 3" : 

: 167 


16.73 
\. T5.71 • 


1.064 


^::-.366' 


'-.'^ :■ ■ — ^ — — 


Total Time for 
Search / 


Between Groups^ 
Within;.Group5:. 


-407 


14142.62 
710,70 . 


.19;90 


• ■■ , ■ • . < 

.5000, 


(RC) VS 

(SC,SM,SO) , 



On the oth^r hand, a user unfamfllaf wi th jChe search J)rocess could stow 
thd search down, requf rfng lengthy explanations durtn'g the . te rmt na I " 
sessions. The Ilbrarfan might also prefer not to have someonp watching. ' - 
over hfs/her shoulder during the search. // . 

IJI t{mate?y, only Santa Clara County made a regular practice of «al lowing 
the patron tO' be present during the search. " Thus figures are available on 
the relative lengths of searches with and without the patrofif 'hut only for 
Santa Clara County* / . " 

-.■ - ji ■ ^ ■ . • 

Of the 103 Santnl^lara County searches reported, 60 w^re performed 
without the patron, and 43 with the patron. The average search time for*: 
those with 00 patron' present was^ 25#0 mirtutes versus 37»9 for those with, 
patron present* The chance of this large a difference resulting simply 
from random fluctuations Is less than* l|; ^searches with* 'the pj^tron take 
significantly longer. However, th€S total time required for all tasks dlfi ^ 
not vary that much; without 'patron, the average was 56. 3- minutes^ wlth\^ 
patron It was 6t.O minutes* there Is a 7.5^; chance that the scampi e means 
are not significantly different. T^hus It Is. not con'cluslve thdt the 
patrol's presence at the sea'rch has an adverse effect on total search time* 
It may be that the patron's presence at the terminal shortens the 1 4 me 
reflulr^ for cither the rjeferencc 'Interview -or for the follow-up with the 
"■patron..' * ^ ' ' ' . " ' ^' " ' 

costs ' , . . ' ■ ; ' " ' ■ ■ ■ ' ' . . ' V 

■ . • , ' . 

/All of these time^ fjgures can now be translated Into costs, using the 
salary an'd fee schedules (Tables' 2 « and kX^ Ratlier than calculate costs 
based on the avet^ge time figures arrived at earlier, the procedure In this 
study was to cajtulate directly the actua*l cqsts for each search based on 
the time requlrledf^ the 'salary of the person performing the task, and the 
dita base(s^ used* '^'v : ' ' ■ 

_ ' The mean sal a)r;jir costs for each task, by l lbraryt are presented' th Table 
13. The figures for the Individual libraries cluster reasonably around the 
means for the group as a whole. The one exceptlon^Xs originating 
library figures, for which only Sar^ Mateo County Iprd encDugh observations tp 
be meaaingful. The costs were quite low, averaging $1*03 for .the reference 
Interview, $1.95 for originating library preparation, $1*P2 for 
DIALOG library preparation y $1.16 for fallow-up at the DIALOG lib raiVV 
$t.07 for oHglnating library follow-up, and\flna11y $>7'^ for the ' * 
post-search/ltl me spent with the user. . 

> Table 1 A presents another analysis of th^ costs Incurred In the on-line 
search itjie If. \' The overall average was $17.29 for computer time, $9*l6 for 

v^ff^llne prtntoMts, an This, 
combined with $^.02 fqr all other labor (detailed*ln Table 9)f brings the 

.cos\i for tl^e.entl^re search process, for all libraries, ta an average of 

:$2t>*M* 



' Table 13 

Mean Salary Gost Per Task By library 
(in dollars) 





' , Mean Task Cost By Library 


Task • 


Redwood pity 


Santa CTara 
County 


San Mateo 
County ^ 


Sarj Jose 


Overall 




Mean 


Mean 


Mean 


Mean 


Mean ' 


'* Reference ^ 
iritervtiew 


$1.04 


$1.1.1 


• $1 ,02' • 


$ .80 


$1 .03 


Orglnating library 
preparation ^ 


. 1.14 ' 


.76 


.2.10 " 


.45 


1.95 


Dialog: library 
' preparation 


1.2-1 r • 

i ■ . b 


T.06 


.97. , 


.87 


1.02' ' 


Search' 


2.03 


2.83 > 


• 1.47 


2.70. 


2.24 


Dialog library ' 
follow-up 


.87 


1.17 


« 

1 .61 


r 

' . 87 


1.16 . 


prginating 












library 

'follow-up ' . , 


.53 


1 .39 
.75 


•1.08 




1.07 


Follw-up with , 
patron V 

. A- 


79 : - 


° .81 


\ 


.74 



Table 14 ' 





.0 


Search Costs 
(in dollars) - 




a 




* • Mean Task Cost By Library 


Overall 


Cost .Element 


Redwood 
. City 


Santa Clara 
County 


Saif Mateo 
County 


San Jose 


Mean 
cost 


Cfata Base Charges 


$14.51 


$22.16 


$10.55 • 


* 

$23.69 


$17.29 


Off -Line Print 
Charges 


9.73 


, 12.60 ■ 


3.64 


• 12. '96 


9.16 


Search -Labor Cost 


2.03 , 


/. 2.83 




2.70. 


2'.24 


Labar Cost for ATT 
Other Tasks 


3.64 


5.91 


6.22 


4.93 


5.62 


Total Co5t, of Search^ 


25.33 

It ' 


35,17 c.. 


19.74 


35.1^ 


.28.41 



^The totalcost.is not additive due to differences in the number of observations 
for each cost element. 



The Indjvtdual libraries dlff*red significantly from thl,s mean, ranging 
.from a low of $19.7^ (San Mateo County) to a high of $35-19 (San Jose) and. 
$35*17 (Santa Clara tounty). Redwood City was .a little below the averagj? at 
$25,33» No one I ten accojunts' for the differences, 

_^an Mateo County, with the lowest overall average,^ had the highest 
LijK)\cost for activity other than time at the ternrrtnaK They more than 
make upr. for this, however, by spending less brt terminal time, both for 
computer time and labor, and al^o by printing far fiswer citations. 
Referring back to the mean time per task In Table 10, It Is evident, that 
San Mateo County's searchers spent slgnl f Icantly. less time &t the terminal 
per searcK. The higher costs for other labor probably ^carne .from the added 
step Incurred when^ requests originate at a library other than the one 
at which the terminal Is located* • - * 

oSanta Clara County and San Jose differed by only a few cents In the 
total search cost but their breakdowns were not Identical* San Jose spent 
more on data base charges, though a little less, on salarfes for the other 
tasks. This Indicates the use of more expensive bases and/or le^s 
expensi^ve personnel (note that their most prolific searcher was 
the unpaid volunteer whose time was evaluated at the Librarian 1* ratej. 
As Indicated InJable.tO., San Jose generally spent a little less : ^ 
time on each task than did Santa Clara County. 

Tp'look a little closer at the search process^ Table 15 presents search 
costs. for the high-frequency searchers. At this level there Is more 
across- library variation. The three Searchers who spent the least salary 
at the terminal ^belong to the low-rartklng San Mat<^ County (searchers 8, 3, 
and '10). Jhe next three lowest are from other libraries, two from Redwood 
City (23 and 25) and one from San Jose (5Z). One of RedwoorflClty's 
searchers (23) Is a relatively expensive Librarian M I . Thte highest salary 
costs" were .incurred by Librarian l*s from both Saft Jose (r>umber 53) and 
Redwood City (26). ' ■ . / 

The data base cha^rges, which are the largest single element In the 
search cost, follow a similar pattern. The six lowej^t searcliers In |erms 
of salary, also account for five of the six lowest searchers In data base 
charges^ The off- 11 n^ print charges, as Indicated earlier^ differ 
strikingly, bringing afl four of Sah Mateo County's searchers down to the 
four lowest total search costs'. San Mateo County searchers are foWowed 4>y 
searcher 23 f rom Redwood City and 32 from 'San Jose* The highest f>tal 
search cost was attributed to searcher 37 of Santa Clara County, f^Jowed 
by searcher 36 from Santa Clara County. \^ 

nenerally, however, differences within a library were not as s^jktng 
as those between libraries. Thusvlt appears that although- Indlv I do|i 
searchers do vary, the overriding consideration Is the library at which 
they are searching.* This could be a result of library poUcy, either 
written or Implied (evidence the San Mateo County effort to keep down the 
nurfcer of prints). It could also be a result of Interaction among the 
searqhers at a library, arriving among themselves at a definition of what 
Is an acceptable search len'^th and number of prlntl. Also, since most of " 
the* searchers received at tea«^t partfof thieJr training from others In their 
own libraries, It could be- that tHe ln|:ramural simtlarl ties reflect a 
common' teacher. , ; ^ ' 



' Table 15 
Mean Search Cost for Selected Searchers, 
(in dollars) 

• ' 0 



Library 


Searcher 
Code 


Search 
Labor Cost 


Data Base 
Charges 


Off -Line 
Print Charges*^ 


To til Cost 


San 
Mateo 


3 

■ 5 
8 
10 


" f • 

■f. 

1.45 
2.24 
0.94 
1.48 


10.76 
12.74 
6.02 
12.17 


2.72 
• 3.15 
4.11 
4,25 


^.1.56 
19.82 
15.35 
21.59 


Redwood 
■ City 


23 

24- 

25 


1.81 
2.84 
1.61s, 
3.43 

' / 


11.80 

20.»90r 

13.02 

24.69;, 


12.29 
7.06 
12.34 
, 5.27 


23.86 . 
32.45 
24.86 
33.37 


J 

, Santa 
Clara 


35 / 
367 

i 


2.561 • 
3. 19 


19.19 / 

23.70 

24.70 


13.(>4 
13,10 
10.97 


33.40 
34.97 
37.57 


San 
Jose 


50 
52 
53 


2i48 
1.89 
3.96 


2L07 
1&.03 
3^.98 

" . r- 


9.67 
15!W 


'34.89 
24.35 
27.13 



/ 

/ 



1 



pJTwo factors determine the computer charges for connect time: the time 
requt^fd for the search and the choice of data base* Is possible to 
separate outt those two effects by considering the ratio of the cost 
of data base. connect time to search time. This has the effect of 
normalizing the connect charge to reflect varying lertgths of time 
spent, search! ng> The actual ratios were: ' • 



Redwood City 
Santa Diara Co» 
San Mateo Co. 
San 4ose 



$ <r7VmIn. 
$ .73/m(n. 
$ .77/nrtIn. 
$ .85/mfn. 



From this it can be concluded 'that all libraries were spending roughly the 
sanie amount per connect mirtute for computer timel San Jose was slightly 
higher, denoting a slight tendency to make greater use of the more 
expensive bases* 

Sfmilarly, the salary cost for any part of the search depended bbth on 
the tirrte spent and tKe salary of the person performing the task(s). ' 
Considering again the on-*lIne search, the^ratlos of labor cost to time at 
the terminal for the libraries were: 

Redwood City 4 .to/ml n. ^ • . i * 

Santa Clara Co. $..09/min. ; * * I* 

San Mateo Co. $ .11/mIn. ' ^ , 

San Jose $ .10/mln. . ' . i 

The 1 1braries did not vary greatly In the overall sjalary cost per minute* 
at the terminal. ' ' , 

Broadening this analysis to the entire DIALOG process^ the ratlo)^ pf the 
total cost of the D I ALOd process ( labor ^ computer charges, printouts) to\^ 
the total time, from reference Interview through follow-up were: 



' Redwood City 
Santa Clara Co« 
San^ Mateo Co. 
San Jose 



$ .71/mIn. 

$ .55/mln. 

$ .33/mIn. 

$ .68/njln. 



t 



their 



A likely explanation for the low San Mateo County figure Is that 
.searches tended to be mor« labor-intensive, >^h Me the others were mor[e 
computer^Iiiitenslve and computer time Is much more' expensive than 
people-time. Redwood CityU searches also tended to use less computed r 
tiDe. However r thel r offHIne printout charge was much higher than $ an Mate<|^'' 
County's and thel r chief /searcher during the data col lectlon^was a 
relatively expensive Libfarlan III (the other libraries relied mainly on 
Librarian l^s)(l).. 

(l)San Jose Public Library has recently Indicated that with the advert t of 
user charges for computer time, they are moving toward a more 
labor-Intensi ve and Aess computer- Intensive search pattern. 
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COr.B I NATIONS OF TASKS 



V , 



In tne description of the DIAUOG proceis as It Is performed In eacfi 
library, It was pointed out that the llbr«r^es dWffered In the emphasis 
-placed on different tasks. For Instance, San Jose made no special' e.f fort 
♦to perform either arfcference Interview or to spend post-search time with 
th<i patron, Santa Clara County, ori the other hand," tried to have the 
patron submit to a reference Interview with a DIALOG staff membe'r, • . 

The greatest rf.umber of tasks 'jthat might possibly be. performed would be 
for a'selarch that originated In a library witliout a OIALOR terminal , for 
which all seven tasks .listed on the time sheef^could be performed. For a 
reauBst originating at a DIALOG library, the maximum number of tasks would 
be five, eliminating the two tasks that are specific to non-DIALdG 
libraries. " 

Table 16. shows the twelve (out of 1-28 possible) comblnattons, of tasks 
that w^re most frequently .performed. Thesis twelve accounted for 338 of the 
searches perTTormed, or ZZ%', The. mos t -used single pattern of tasks-was 
number ten tfn- Table M. This pattern consisted jof a reference Interview, 
DIALOG preparation, search, DIALOG follow-up, and a fol low-up-wl th us^ei-, . 
the ••complete" DIALOG-Msrlglnatlng pattern. The next most common was ^ 
pattern, seven, the same as ten but with the DIALOG preparation omitted. 
Pattern twelve, every possible task performed, occurred only ten times. 

Gfvcn that different patterns of tasks mean that more or fewer steps 
are performed for each s<sarcK/ Tt follows that different patterns 
result In different costs. - 

' ■ * ' ■ ^ , ' ' 

^ Table 17 shows the me/n total search cost^ by library, for*^each of the 
frequently occurring combinations of tasks. Surprisingly, the lowest 
overall mean Is the orje With the most tasks (combtnatron number 12) • This 
'figure is not conclusive^, however, due to both the low number of 'cases ' " 
(tfert) and the fact that all cases were from San Mateo County,^ which had 
consistently low search costs. j , 



second least costly (agaln'^wlth figures only from one library, In 
c^e Redwood Cfty) was the sixth Instance, which consisted of a 
^(T^erence Interview, the search, and follow-up with patcon. 

. ■ . ' ' - ' ' «f ■ ' . 

Interestingly, the bare bones search - no task p.rfowned othe^ than 'the' 
actual on-line search - although Inexpensive, at $15.67 (number one), was 
only the third least expensive combination. ^ 

The most expeive comblnatloir, conslderl'ng all libraries together, was 
corublnatfon nuitfcer eight, reference Interview, search, DIALOG library 
follow-up and follow-up with user at $38.08. The next most expensive was 
pattern number ten, which Indludes all the tasks In combination eight plus 
DIALOG library preparation. The additional task lowere'rf the cost to $3'>.23, 
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^ Table 16 ■ _ 

Most Frequent Combinations of Tasks Performed for DIALOG Searches 






Combination of Tasks, - „ ' 


Frequency 
of 

jccurreng 


Combin- 
ation 

Number 


Reference 
Interview 


Originating 

Library 
Preparation 


Dialog 
Library 
Preparation 


Search 


dialog 
Library 
follow-up 


Originating 
Library' 
follow-up 


Follow-up 
with User 


1 


0 


0 


0 . 


1 


Q w 


0 


0 


21 i 


Z 


0 




0 


1 . 


1 


0 


'/V 
o 0 


22 


3 




0 


■ - 1 ■. ■ 


1 




■ 1 

0 


.> ■" • 


21 


4 _ 


0 


0 


1 


1 




. 0 ' 


1 


11 


5 


1. 


0 




1 


* * 
' 0 


0 




35 

4 




1 

1 


0 


0 


1 • 


0 


• 

0 


1 


10 


7 


1 


0 fl 


0 


1 ' 


1 


"0 


^0. 


44 ' 

•t*T 


8 


1 


0 ' 


0 , 


1 


'1 


0 


' 1 




9 


1' 


0 


. • 1 . 


•1 
/ 
1 


1 


0 


0 


40 




1 • 


0 


1 




0 " ; 


. 1 , 


' 70/ :| 


IT ' 


1 


1 


" 1 


■r 


1 


•". '1 - ' . 


& • 


13 


12 


1 


1 


1 




1 


1 


1 


10 1 


Total 








338 i 



Note: 0 indicates task not perfomied; 1 indicates task was performed. 



Table 17 - 

Total DIALOG Search Cost fpr Frequ^tly Occuring 
» Conin*natio.ns of Tasks 
' (ln dolTars) 



Combination 




Me^n Total Search 


Cost 


Number 


Redwood 
City ' 

1 


Santa" 
" CI ara . 


San 
Mateo 


San 
Jose 


All 
Libraries 




16,85 


22.01 


15,62 


12.00 „ 


_4J5.67 


2 


23.42 , 


76.30 


10.20 


31.56 


25.50 


• 3 


35.30 . 


33.86 


18.92 




25»97 

.r 




35.30 


- 33.86 


18.92 


47.85 


25.97 


■5. X- 


23.11. 


9.62 




23.43 


6 


9.75 








9.75 


7 


25.96 


28.30 




35.26 


28.13 . 


8 


26.82 


43.93 


16.33 


28.56 


38.08 


V 


29.59/ 


28.40 


16.07 


38.71 


31.09 


. 10 


7 

33.40 ' 


•^9.62 


19.62° 


36.90 


34.23 








•26.07 




26.07 


12 




* 


V 1.61 




.1.61 
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These data^-on tasK' combinations Imply that there Is no direct 
correlation between the number of tasks performed and the cost of the 
searchi. San Mateo County had the lowest average cost, whilie generally 
performing more tasks per search than other libraries did* 

' ■ . •/ . ■ ■ • . 

ELAPSED TIME v . 



^Two fncasures of time are Important to the user of anw^ltlnd of search 
sisrvlce; One Is the' time that the usfer or Ms/her sufrogate actually 
spends on the search-^ The use of on-ltne searching reduces this measure 
frpm hours, even days, which must be spent leafing through abstracting and 
Indenting puBl|;f atlons, to only minutes spent conferring with the search 
personnel. 

The second measure Is waiting, time how long the user must wait from * 
^the Instlgiition of the request until the results are. received. The waiting 
utlme Is an l^vdlcatlon of^how quickly the search service procissses the 

^■Jrequest* . -^^ 

iThe mean tlm^ that requests spent In the system, ^ I) from the first 
patron contact until the last task (whatever that was) for all of the 
libraries' together was 7*79 days (calender, not working ^ays) « For the 
Individual libraries the figures were: Redwood City, 6.02 days; Santa Clar^ 
County, A«87 days; San Mateo County, 14«67 days;, and San Jose, 6.79 days./ 
(2) . - :^ - , . . j', 

Table 1 8 analyses thi& data further. This table shows the mean .time / 
'between various pairs of tasks, by library. Not every task was performed 
for each search; the figures are only for those cases In which both / 
elements of the pal r In question werife performed. It' Is al&o worth noting 
that the pairs examined were not necessaV|4y successive t&sks,- but thos4 
for which a significant "^number of observations were available. There ^s 
overlap among the pairs "examined, e,g. reference Interview to. search 
subsumes reference^ Interview to originating library preparation, reference 
Interview to 01 ALOh library preparatlpn, antl DIALOG library preparation to 
search. - . ■ ^ ■ ' ' *' , 

Re<iwood Clt^^s data sfjow a regular progression through the tasks/. 
Reference Interview to^search required, about two days of the six overall; 
search to fol low-up with patron tended around three days. Const der/ing th^t 
off-line printouts were sent first class mail, and required a mfnljtium of 
two days to arrive, the figures were quite go^d. / 

* . - ".■■>. . , ■ 

(I )The minimum time possible t$ one dqy and that Is for s^meylay service. 

iZlM] 0^ the libraries would expedite rush requests. If the ^ktron had a 
good reason. , *\ ■ ^ j . V 



Ta6le 18 
Days Elapsed Between TaSks. 
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" Library ; 


M 
E 




Keawooa uny. 


vail ta 


V/ 1 a 1 a 


ban Mateo 


San Jose , 


• 1 asK interval 


Mean 


# Of 
obser- 
vation 


Mean 


# Of. 

obser- 
vation 


Mean 


# of 
obser- 
vation 


Mean 


# of 
obser- 
vation 


: A . 

N 


Reference Interview to 
Originating Library 

r re pa rat ion \ 




« 


\ 

■ 


* 


1,74 


14 


\ 


■ . 


• 

1 .74 


Reference Interview to 
Dialog Library 
Preparation 


1'.91 


' 24 


2.23 


38 


4.63 




5,46 . 


. 47 


3.90. 


Originating Library 
Preparation to Dialog 
Library Preparation 


/■ . 




4.50 


2 


4.94 


37 






H.9 


Dialpg library . 
Preparation to Search 


'.59 


41 v. 


I .88' 


'„4r, ■ 


3V77 


76 


0.75 


\ 58 ■ 


1.79 


Referenced Intervi ew to 
Search * 


1:93 


92 \j 


, 3.Q5 


.^-89' 


8.77 


58X 


6.12 


\ 56 


4.9 j 


Sear^jai'to Dialog,^ 
-Hbrary- Fol low-Up 


1 .60 


66 • 


• 0.1,6- 


92 


U5 


83 


1 .08 


67- 


1.19 


Search to Qriglnatirig 
Library Follow-up 


2.00 


- ^< ■ 
2 


2.50 


.2- ■ " 

s, ■ 


7.31 


38 








\ Search to Follow-Up 
With Patron ' 


.3.03 


. 30 


^2.66 


66 


' 7.72 


43 . 


'-:^03 


31 


4.00' 


Dialog Liorary rollov/- 
Up.tq Originating 
Lily^'ary Fallow-Up 








» . *, 


6.00 


38 


V 




V 

6.00 

0.93 


Originating 'Library . 
Follow-Up to Follow- ' 
Up With Patron 








, 'A 


0".93 


15 






Dialog Library Follow- 
Up to FollowiUp With 
Patron ' 

♦ . » " * 


1.70^ 


V 

, 20 ■ 


3.70 


60 


.7.34 

* 


<^ 

41 


. 2.26 


'30 


4.14 


Average tiitie in system', 
all cases \ , 


6. 02 


140 


\ 4.87 




14.67 


91 


6.79 


77 


7,79 
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Santa Clara Coun.ty shaved about a da/ off Redwood Ctty's tlrne, 
primarfly In thepost-search tfme* the Santa 'Clara County of Mine print 
figures shelved a greater tendency on the^T)art of searcKer^ to request no 
offHIne prints. This tendency ml g(;\t have been^ a result -^'having the 
patron present frequently^ (citations that might Rave been ^^prtnted off'-llne 
In the patrons' absence might be pr1n|ed on-^llfie or not a^ all). This 
would el iminate the wSlt for the U.s/Postal Service and irHght account for 
Santa Clara County's lower. post-search figure. . ' 

^ ^San Mateo County was the slowest of the group, at 1^,67 days. Tabl^ 1R 
shows them wi th Icons I stent ly^ higher figures* than the other libraries, with 
the timev divided almost equally between pre-; and post-search (8*77 days vs. 
7*72). San Mateo County was the"only library with a significant number of 
tas^ks performed at the originating library, which added a step and a 
possible bottleneck-^o the search process. It may also be that the lack of 

jdl rect contact wjlth the patron made San Mateo County tend hot to hurry In 
searching a request once It wa^s Vecelved. Furthermore, 'DIALOG requeists 
were cofnpeting with other subject requests received from the branches In 
much the same way as the DIALOG requests. In other words, piALOG-irequests 
sln|ply jiad to'^walt th^l r turnv 

. San Jose's total of 6.79 days was a distant Second'to San Mateo County* 
The bulk of that time (6.12 days) was pre-search, echoing San Mateo 
Cauitty*s pattern of having the^ request pit waiting. In this case, however, 
tbe watt was\for San Jose pa rf^ time searcher. Also, the San Jose staff 
had cbmplalnei^ early In the project of being squeezed between DIALOG and 
their regular duties. tNl$ long pre-Sjearch wait and shiort post-search time 
sugc|es^t a- general backlog. Items were handled speedily^ once their turn 
came, but there\were others competing JF^r the staff's attention. 



CONCLUSIONS 

of ^on-^ line bibliographic searching In 



This study has rep^rte<J^fhe 'jcosts c 
four public libraries /n the San F/ancIsco Bay Area using the Lockheed 
DIALOG system. This s^tudy was^ conducted durlrtg a period when search 
tlr«)e was j^rovlded to the libraries wltnout charge- and the searchers were ^ 
moderately experienced.. It was found thatVthere were seven different tcTsks 

i'nvplved In the search process. In the course of the study 35 Individuals 
rom the four 'l\lbrar^es reported their own processing times for Ml search 
equests. * ^ / j , 

^ . ^- ■ \ • ! ■ ] ■ ' ' 

Two limitations/ shou1d-be considered In evaluating the results of this 
study. One Is the self reporting nature of the data. Participants 
recoir^ded tl-m^ spent on search tasks rather than being observe^i and measured 
by others. Consequently, a possible bias Is thtjx)duced depending on the 
accuracy with which the searchers recorded their times. A second 
llnltatlon Is the experimental nature of the project. On-line searching of 
the DIALOG system was provided at no cost to the public libraries through a 
grant from the National Science Foundation. Thus the searchers were under 
little economic pressure to perforr^f fecti vely. 



V Considerable variation In the time recjul red to perfom- searc^^^ 
found between IfbYarles and between sfearchers* v ^ot* exampjl^^^ 
corifiect time to a data base for an ^ncll vidua 1 search was^ ^2 mtnuteSc/^^^ 
But thfs vai^led from 19.()5 mllifites at the Redwood CltY...fi:M^^ to 

minutes, at Santa Clara to 28,31 minytes at' th« Sa^^^ PMbl lc 
Library. Strnl lar variations were found tolh^ overall cost of a 
blblfoflraphlp search:" Kedwodd Clty.^s average was $25. 3B, Santa>tlara's was 
$35^0, San Mateo's was $19.7^> San J6se's was $r35i19. and the pverajl 
average for the 411 searches was $ZS»h] . The most expensive portion of the 
overall cost was the actual on-line search time, which averaged $17.79 for 
all searches. The next most expensive elemeht of the . totaf cost was that 
of ftlFfj^irne pi^4^ts~this averaged^ $9. 1^^ for all searches.' 

^ The only element that was omitted .from the cost calcu4atl6ris ,waS\ , 
XtWedUohe 1 ine charges. This was due to th'fe fact that the four Hbraries 
Wiftrc I g close phys i cal p/oSflmlty to Lockheed |s computer cenferv If this - 
si tuatlon did not Hold for other searching locations 'I t wotKd "be he'cessary 
iSb. arfd the telephone Vcosts. Assume a $10 per hour telephone connect charge 
through an organisation such as TYMSHAPE, and a mean search time of^2?«7?' 
^minutes. ^Th Is resj^ult^ In an aver&ge'^ telephone charge of $3.79 which, when 
addled tp the $28.41 search total ^ totals $3?..20 foV the. average search. 
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. / ^ DIALOG TI^ SHEET . ^ 

■ . ^- - . ^ ' ' ' * , ' - 

' Please enter tlt^e In minutes to the iiearest five minutes. Please date and 

I .initial each entry* ' p 

DIALOG UBRARTS iV KCPL 2. SCCO^ 5- SMC O 4> ' ' ' : 

' . ' Patron .name" (optional) t 

. / Reiai|%st number: • . » 



Originating Library^ 



t 








EVENT 


— ^3^- ' •■ ". ■ = ^ •■ 

TIME IN * ^ . DATE N INITIALS 
MitniTES \ ^ 


REFERENCE INTERVIEW 
1 InttlaX patron 
1 contact 




ORIGpATING LIBRARY 
PiREFARATION TIME 
i without patron 


• „ ' ' ^ . ' a , . ■ 
- *■ ' . ■ ■ * * ' 


flIALOG LIBRARY 
' liREPARATION TIME 

! w^^hn1t^- nat-rnn 


'^' ■^ '■■ • V . . ■ ■ « . fe . . 

■ -^^ . ' -^^ . ■ • ; 0 - ■ ^ . ■ ' 




lALOG COiJNECT 
IME ■ 


don't enter time (do date and initial) : 

' r. ■ ^ ■ ' ' — ^ ^ — \ u — 




lALOG LIBRARY 
OLLOW-'llP TIME 
without natron 


.0 • , ■ * ' - 


C 
I 


RIGINATING LIB-RARY 
OLLOWr-UP ,TIME ■ 
without pat;ron ' 




I 


OLLOW-UP TIME 
wl^^h patrqn 




■ I 


lISC'feLLANEOUS 
describe: 




■ * .. t— '. — . ^ " 1 


DIALOG CONNECT TIME' ' Patron present? Check if yes _ 










: ' DATA BASE 

♦ 


' •"' - — . — ' — , ' ' • " — 

^LAPSED TIME ^ NO. OF OFF-LINE PRINTS 



Appendix B 

■' ■ . ' • ' '■ . ■■ ■ 

Alternative Cost Calculations 



In 'Tables 1'3 and li|. of the text the mean salary costs and mean search ' 
costs were summarlzedV These tables were calculated on the basis * that each 
occurrence of a task resulted In a cost of performing the task and that the 
^total cost was the sum4of the task costs for all tasks which were 
performed. , . 

\ Tables B-1 and .B-2 are the analogies to Tables 13 and l^* wi th a 
different method of computation used. In Tables B-1 and B-5 the mean unit 
•cdst of a task Is determined by dividing the total cost by the total number 
of\ valid observations, not'just the number of observations for which the 
tliW was non-zero. V/hl le the mean search costs (Tab I e B-z) remain' 
relatively stable, there Is a considerable reduction In the salary costs 
perltask (Table B-1). - * 
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Mean Sa1ar)f| Co€i Per Task by Library, 
All Entries 

fin/dollfes) 





■ . Mean Task Time by Library 




Redwood 
City 


^anta Clara 
County- 


San Mateo 
County 


San 
Jose 


'Overall 




Mean 


Mean 


Mean 


Mean 


Mean 


Reference 
interview 


.68 




1.05 \-. 






; .75' 


Originating ' 
library 
preparation / 
» 








a. * 




/' .. 

.ZZ, 


Otalog library 
preparation 


. .39 




.46, 


.81 


.64 


: .55 • 


r 

Search. 


2.03 




2,83^ 


.1.47 


2.70 


- 2.24 


Dialog library 
follow-up 


.42. 




1.04 


'1.44 . 


|/'75-i^ 


• .87 


Ori gi nati ng 
library v 
foVlow-up 








".44 


V , ■ _ ■ \ 


.11 


Follow-up 
with patron 






\ V • 

/ .48' 


% -37 * 

— ■ — ■ — ■ — ' — " 


.24 


.34' 



; Table B-2 / 

■■^ ■ . ■ ' 

Mean Search Costs., All Cases / 
(in dollars) " / 
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